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Kipnis and Varadhan showed that for an additive functional, Sn 
P^ ■ say, of a reversible Markov chain the condition E{S^)/n — )■ k G 

1-^ ■ (0, oo) implies the convergence of the conditional distribution of 

Sn/\/E{S^), given the starting point, to the standard normal 

distribution. We revisit this question under the weaker condition, 

E{S'^) = n£{n), where £ is a slowly varying function. It is shown 
Kf" I by example that the conditional distribution of Sn/ \/E{S'^) need 

Ps| , not converge to the standard normal distribution in this case; and 

sufficient conditions for convergence to a (possibly non-standard) 
ly^ . normal distribution are developed. 
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operators; slowly varying functions. 
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1. Introduction 

Consider a reversible Markov cliain . . . W-i, Wo, Wi, . . ., defined on a proba- 
bility space (fi,^, P), with a Polish state space W, transition function Q, and 
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marginal distribution vr. Thus, 7i{B} = P[Wn G B], Q{w; B) = P[Wn+i G 
B\Wn = w], and (the reversibihty condition) 



/. 



Q{w;B)7r{dw}= Q{w;A)7r{dw} (1) 

Jb 



'A 

for Borel sets A,B C W, w G W, and ra G Z. Using (and abusing) notation in a 
standard manner, we write 



Qfiw) = / fiz)Q{w;dz) a.e. (vr) 

for / G -^^(vr) and Q^ = Q o ■ ■ ■ o Q for the iterates of Q. In addition, let 
L^(7r) = {/GLn7r):/^/rf7r = 0}, 

K = J + g + ■ ■ ■ + g"-\ K = (1^1 + . . . + K)/n, 

and let || ■ || denote the norm in an L^ space, either i^^(vr) or L'^{P). Finally 
=^ denotes convergence in distribution and =^^ convergence in probability of 
conditional distributions; that is, if Z^ : ^2 — )■ M are random variables and G is a 
distribution function, then Zn\Wo =^^ G, means that the conditional distribution 
of Zn given Wq converges in probability to G. 

The reversibility condition ([1]) is equivalent to requiring {Wq, Wi) and {Wi, Wq) 
to have the same distribution, since the left side of ([T]) is P[Wo G A, Wi G B] 
and the right-hand side is P[VFo G B, Wi G A]. An important consequence 
(also equivalent) is that the restriction of Q to L?'{i^) is a self-adjoint operator. 
For, letting (-, ■) denote the inner product in L'^ij), {f\g) = /w /fi"^^' if^Qo) = 
E[f{Wo)g{W,)] = E[f{WMWo)] = {Qf,g) for all f,ge L\ti). 

Given g G Ll{n), let X^ = giWu), 5„, = Xi + ■ • ■ + X„, and al = E{Sl). 
Kipnis and Varadhan [7] showed that if 

2 

lim ^ = fi:G [0,oo), (2) 

n->-oo n 

then the conditional distribution of SrJ \/n given Wq converges in probability to 
the normal distribution with mean and variance n. It is shown in Proposition 
[1] that K > except for trivial special cases; then a~^Sn\WQ =^^ Normal[0,l]. 
In the proof, Kipnis and Varadhan showed that Sn could be written in the form 
5"^ = M„ -|- Rni where = Mq, Mi, M2, ... is a square integrable martingale with 
(strictly) stationary increments D^ = M^ — M^-i and ||-Rn|| = o{^/n). The result 
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has applications to Markov Chain Monte Carlo, for instance, [12], since many 
algorithms lead to reversible chains; and, to interacting particle systems, [6] and 

Here we consider the case in which ([2]) is weakened to 

a^ = n£(n), (3) 

where £ is a slowly varying function, as defined in Chapter 1 of [2]. An example 
will show that the main result from [7] does not extend completely. Some features 
do extend, however. For the remainder of the paper reversibility is assumed along 
with g G Ll{n), and (. is defined by ([3]). 

Further developments under the condition ([2]) may be found in [3|; and (TU] 
is a recent article on asymptotic normality of sums of stationary processes with 
non-linear growth of variance. 

2. Generalities 

In the first proposition, it is shown that only the case lim„_^oo ^l'^) = oo needs 
to be considered. The relation 

al= [2{g,V^g)-\\g\\'']n (4) 

is used in its proof. 

Proposition 1. // liminf„_5.oo^(^) < oo, then ^ holds; and if liminf„_j.oo-^('T') = 
0, then S'n = |[1 + (— l)"~^]Xi with probability one. 

Proof. Since Q is self-adjoint, we may write Q = j\ XdM{X), where A C [—1, 1] 
is the spectrum of Q and M is a countably additive, projection- valued set function 
defined on the Borel sets of A. Then Q'' = j\\^dM{\) for all k > I. See 0, 
Chapter 2. Let ^g{B) = {g, M{B)g). Then /i^ is a measure, and 



{g, Vng) 



\fl-X 



n\ l-\ 






Observe that the integrand on the right side of ([5]) is non-negative. So, if 
liminf„_j,oo-^('^) < C)0, then the limit inferior of the left side of ([5]) is finite and, 
therefore, 

r flg{d\) 

Ja 



^-^ < oo (6) 

i — A 
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by Fatou's Lemma. It is clear the integrands on the right side of ([5]) are dominated 
by an integrable function, hence the integral converges to that on the left side of 
©, and 02]) holds with 

f dfig{X) 2 /" 1 + A 

If liminf„^oo ^{n) = 0, then the last integral is and, therefore, fig is a point mass 
at {-!}. It follows that Qg = -g, E[{Xo + Xif] =0, X^ = (-l)X„_i w.p.l, 
and Sn = |[1 + (-l)"-i]Xi w.p.l. 

As a consequence there is no loss of generality in supposing that i{n) — t- oo, 
and we shall do so where convenient. For if liminf„_5.oo^('T-) < oo, then the 
Kipnis-Varadhan result is applicable. 

The proof of the next proposition uses (jlj) and 

fc=0 ^ ^ 

Proposition 2. If i varies slowly in ^, then \\Vng\\ = o(cr„). 
Proof. Using the reversibility and ([7]), 

n—l n—1 

\\Vn9\\l = J2Y.(9^Q'^'9) 

j=0 k=0 

n-1 2n~2 

= J2i^ + l){g,Q'g)+Y.(2n-l-z){g,Q'g) 

i=0 i=n 

2n-2 n-1 

= Y,{2n-l-z){g,Q'^g)-2Y,in-l-t){g,Q'g) 

i=0 4=0 

1 



- [<„i + (2n - l)l|^f ] - [at, + {n- l)\\gr] 

2 2 I -'- II ||2 

The proposition then follows directly from ([3]) and the slow variation of i. 

Corollary 1. Ifi varies slowly, then there is a sequence of square integrable mar- 
tingales = Mn^i, Mn^2, ■ ■ ■ with stationary increments Dn,k = Mn,k~Mn,k~ii k > 
1, for which maxfc<„ \\Sk - M^^kW = o{an)- 
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Proof. This follows from Proposition [2] and Theorem 1 of [13]. It is relevant 
that 

Dn,k = Vng{Wk) - QVngiWk^i) 

and Mn^k = -D„,i + ■ ■ ■ + D^^k in the proof of the latter result. 

Corollary 2. If i varies slowly and there is a X>0 for which 

1 " 



^-fc=i 



and 

1 " 
-^J2^^^l>'M\D.M>^..}\Wk-i) ^'0 (9) 

" fc=i 
for every e > 0; then 

— \Wo ^^ NoTmal[0, \]. (10) 

Proof. This follows from the Martingale Central Limit Theorem, e.g. [1], pp. 
475-478, applied conditionally given J^o := cr{. . . W-i, Wq). For A = 1 the proof 
is detailed in [13], and the extension to A 7^ 1 presents no difficulty. 

In the next proposition we write S'„ = Sn{g) and o"„ = an{g) to emphasize the 
dependence on g. We also use the following: 

Lemma 1. If Zn\Wo ^p G and Z'^ - Z„ ^p 0, then Z'JWq ^p G. 

Proof. Lemma [T] follows from the unconditional version of Slutzky's Theo- 
rem, by considering subsequences along which convergence in probability can be 
replaced by almost sure convergence. 

Proposition 3. If i{n) — )■ 00, and / fTZ^) holds for a given g, then for any j > 1, 
(^n{Q''g) ~ <^n{g) o-nd / flOj) holds with the same A when g is replaced by Q-'g. 

Proof. It suffices to prove the corollary for j = 1; and in this case it follows 
from Sn{g) - Sn{Qg) = Yl=i[9{Wk) - Qg{Wk-i)] + Qg{W^) - Qg{Wn)^ which 
implies 

|o"n(^) - (yn{Qg)\ < \\Sn{,g) " Sn{Qg)\\ 
and Lemma [T] above. 
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Remark 1. The proof of the Proposition [3] did not use the reversibihty and, 
therefore, is vahd for any stationary process. 

Remark 2. Proposition |3] illustrates an important difference between the case 
i{n) — 7- oo and i{n) — )■ n, considered in |^. For if (|2]) holds, then 



K, 



K{9)=2\imY,(^--){9,Q'9)-\\9\ 

fc=0 ^ ^ 



:iii 



It is then not difficult to see that ( TTTj) holds when g is replaced by Q^ g\ and 
[i^{g) + ■ ■ ■ + K{Q'"'g)]/n approaches zero as n — )■ oo, by Theorem 2 of [H]. 

Remark 3. Kipnis and Varadhan showed that if (12]) holds then Dn^k converges 
in L^{P) for every k. Clearly, this is impossible if £{n) — )> oo. If it were the case, 
however, that Dn,i/ yUn) converged in L'^{P), then ([8]) and (Q would follow 
easily with A = 1, and the conditional distributions of Sn/cTn would converge to 
the standard normal distribution, as noted in [13]. This hope cannot be realized 
either, however, if lim^^oo^l'^) = oo. For, Dni/ y^£{n) cannot be a Cauchy 
sequence, in this case. To see this first observe that 

2 



D 



n,l 



D 



m,l 



and 



VK 



m) 



i{n) 



\D. 



n,l 



+ 



1 



£(m) 



\D 



m,l 



^i{m)i{n) 



\Dm,l, Dn,l) 



(An,i, Dn,i) = {Vng{wi) - QVng{wo), Vmg{wi) - QV^g{wo)) 

= {Vng, Vmg) - {QVng, QVmg) 

= {Vng, Vmg) - {Q'^Vng, Vmg) 

= {{I-Q^)Vng,Vmg) 



{{V2--QVr,V2)g,Vmg). 
n 



So, for any fixed m, 



lim 

n— >oo 



Dn.l Dm.l 



Vi^ V^M 



1 + 



i{m) 



-Dm,l 



and, therefore, 



lim lim 

m—^oo n— >-cxD 



DnA DrnA 



v/fR V^M 



2. 
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3. Examples 

For a simple reversible chain, let i/ be a probability measure on the Borel sets 
of M and p : M — )■ (0, 1) a measurable function for which 

9= / <oo; 

and let 

Q{w- B) = p{w)1b{w) + [1 - p{w)]u{B} (12) 

for Borel set i? C M and ly G M. Then Q is a stochastic transition function with 

stationary distribution 

du 
an = 



Ki-pY 

and ([1]) is satisfied. Thus there is a reversible Markov Chain . . . W-i, Wq, Wi, . . . 
with transition function Q and marginal distribution it. This construction is 
classical and is described in [TT], pp. 134-135. 

Now let To,Ti,T2, . . . be the times before the process jumps, tq = max{n > : 
Wn = Wo} and 

Tfc = max{n > r^.i : Wn = Wri^_^+i}. 

Then Wr^ = PKfe^i+i, and 

St,^ = TqXo + (n - To)Xr-, H h (r™ - Tm-l)Xr^. 

By the Markov property, {to,Wo) and [{tj — rj_i), Wj-J, j > 1 are independent 
random vectors for which PVV. ~ u and 



P[Tj - Tj_i > k\Wr- = W]= p{w) 



fc-1 



for all w e W, A; > 1 and j > 1. It follows that E{rj — rj^i\Wrj = w) = 
1/[1 — p{w)] and 

Jw ^ P 
By way of contrast, WVo = Wq ~ vr, and E{tq) = f pdn/{l —p), possibly infinite. 

Let Yj = {tj - Tj^i)Xr^ and T„ = Fi H h Y^, so that Sr^ = tqWq + T^. Then 

Yi,Y2, . . . are independent and identically distributed; moreover, E{Yj) = 0, since 



E [(r, - r,_i)X.J = E 



l-p{Wr. 



du = 6 i gdn, 



1 — p 



w ^ ~ P Jw 
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and g G -^o(^)- Let 

Hiy) = [ YfdP, 

Ay3\<y 

and recall the following version of the Central Limit Theorem for i.i.d. variables 
(with possibly infinite variances), for example, [U pp. 576-578]: If Yi^Y2^ . . . are 
(any) i.i.d. random variables for which E{Yj) = and H{y) varies slowly at oo, 
then there are 7^ for which 

Im ~ 'm'H{'jrn) and -^ =^ Normal[0, 1]. 

7m 

The following lemma is intuitive. The proof is presented after Proposition |4] 
is established. To state it, define integer- valued random variables ?n„ such that 
rm„<n< Tm„+i forn = 1, 2 . . . . 

Lemma 2. As n ^ 00, S'„ — Tm„ = Op(l); and if H varies slowly at 00, then 

Tm„ -T\nle\ = Op(7n)- 

Proposition 4. If H{y) varies slowly and 7^ ~ niHi^m), then 



^iVTo^P Normal 

In 



^ 



Proof of Proposition^ That Tmllm =^ Normal [0, 1] was noted above. So, 
since 7[n/6ij ~ In/Vd, Tyn/e\hn =^ Normal[0, 1/^]; and since Wo and T^ are 
independent for all m, the conditional distributions have the same limit. The 
proposition now follows directly from Lemmas [T] and [2J 

Proof of LemmalE First observe that Sn — Tm„ = tqWo + {n — Tm„)W^r,„+i- 
It is clear that tqWq is stochastically bounded and that |(n — Tm„)Wr^^^-^\ < 
(rm„+i — ''m„)|W^r„„+il- To scc that the latter term is stochastically bounded, let 
/ denote the marginal mass function of Tj — Tj_i, j > 1. Then the asymptotic 
distribution of rm„+i — Tm„ has probability mass function f{k) = kf{k)/9, by the 
Renewal Theorem, [U p. 271], and the conditional distribution of WV„i„+i given 
Trrir^+i - rm„ does uot depend on n. That {Tm„+i - rm„)|W^r„„+il = Op{l) follows 
easily. 

The proof of the second assertion uses the following version of Levy's Inequality 
[3 p.259]: If H varies slowly at 00, then R-^ := inf{min[P(Tfe < 0), P{Tk > 0)] : 
A; > 1} > 0, and 

<KP[\Tn\>t] (13) 



P 



max |Tfc| > t 

k<n 
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for all t > 0. Observe that 



P 



\^rn„ -^Lfjl ^ ^7n 



+ P 



n 






max 

\ke-n\<e5n+e 



(14) 



The first term on the right approaches for any 5 > by the Law of Large 
Numbers. Letting Nn = [n6/9\ + 4 and using ( TT3l) . the second is at most 
2KP[\Ti\f^\ > e'-fn]. So, by the Central Limit Theorem, the limit superior of 
the right side of ( !T4|) is at most 4i^[l — ^{e/\/6)], which approaches as 5 —t- 0. 
For the example below, observe that if / G -^^(tt), then Qf{w) = p{w)f{w) + 
[1 — p(w)] /yy fdv. So, if W = M, z/ is a symmetric measure, p is a symmetric 
function, and / is an odd function, then Q""/ = p"^ x f. 

Example 1. Consider (fT2|) with, p{w) = e"^/'"'', 

[1 — p{z)]dz 



iy{dz} 



2^2 



for \z\ > 1, 



(15) 



in which case 6 = e and 7T{dw} = dw/2w'^ for \w\ > 1. Let g{w) = sign(u;). Then 
g E L^iTi), Q'^g =p'' x g, and 

r r°° rlnn 1 /"" 1 

(g^Q'^g) = / P'^dn = e-^— = - e-^dx ~ -. 
Jr Ji w^ n Jq n 

It follows that {g,Vng) ~ {g,Vng) ~ log(ra) and a^ = [2{g,Vng) - \\gf]n ~ 
2nlog(n). So, ([3]) is satisfied with £{n) ~ 21og(n). 

Recall the definition of the Tj and the distribution of [r,- — Tj_i, Wrj]- Then 



P\\(t. 



Tj^i)Xr^ \> k]= P[{tj - r,_i) > k]= p^du = e / (1 - p)p^dn. 

Jr Jm. 



The last integral in the previous display is just 



_i\ _kdz 1 
1 - e - I e ^— - = - 

z^ k ./o 



1 - e fe j e ^c/y ~ — / ye ^dy = —] 



thus. 



P[|(r,-r,_i)X.J>A:]~^. 



(16) 



It follows easily that H{y) ~ 2elog(y) = ei{y), 7^ = 2enlog(7„) ~ enlog(n) 

1' 



|eo"2, and, therefore 






Normal 



0, 
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(a non-standard normal distribution). 

Since E{a~'^S'^ is bounded, it follows that E\Sn\ ~ vr^za^ and, therefore, that 
SrJ E\Sn\ =^ Normal [0, ^n]. The latter convergence can also be deduced from 
Theorem 4 of [10]. To do so, it suffices to verify Equation (3.2) of that paper: 
Since \g\ < 1, it is not difficult to see that the term whose limit is taken in (3.2) 
is at most cr~^ Sfc=i ^/3fc, where f3k is the coefficient of absolute regularity. So, 
it suffices to show that /3„ is of order 1/n, and this may be deduced from the 
equation at the top of page 136 of [11] together with the relation P[to > n] = 
J^p^dn ~ 1/n. (The r in [11] is our tq + 1.) Conditional convergence is not 
asserted in Theorem 4 of [10] but is implicit in the proof; that -E|S'„| ~ vr~2(T„ is 
not deducible from that theorem, however, because Sn is not normalized by (j„ 
there. 

Example 2. A slight modification of Example 1 produces a very simple bounded 
stationary sequence whose normalized partial sums converge in distribution to a 
stable distribution. Other examples may be found in [Sj. If ( fT5l) is changed to 

for \z\ > 1, where 1 < a < 2 and 7^ = J^ 2/°~^(l — €.~y)dy, then 7i{dz} = 
{a - l)/{2\z\'')dz for \z\ > 1, and 

T(a) 



P[Y>y] 



lay" 



as y — )■ 00. It then follows that n a Sn ^ Z, where Z has a symmetric stable dis- 
tribution with characteristic function e^"^"'*'" and Cq, = (a— l)r(a) J^ x~°' sm.{x)dx. 
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